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[57] ABSTRACT 

A knowledge worker productivity assessment system (10) 
includes a database (12, 14, 16) containing survey data (15) 
generated using a knowledge worker productivity assess- 
ment framework (2). A benchmark database (18) contains 
benchmark values. A retriever (20) is coupled to the data- 
bases (12, 14, 16, 18) to retrieve selected survey data (15) 
and benchmark values. A calculator (38) is coupled to the 
retriever (20) and generates a comparison value (39) using 
the selected survey data (15). A relator (40) compares the 
comparison value (39) to a selected benchmark value to 
generate a knowledge worker productivity assessment. 

20 Claims, 3 Drawing Sheets 
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SYSTEM AND METHOD FOR GENERATING 
A KNOWLEDGE WORKER PRODUCTIVITY 
ASSESSMENT 

TECHNICAL FIELD OF THE INVENTION 

This invention relates in general to the field of produc- 
tivity analysis, and more particularly to a system and method 
for generating a knowledge worker productivity assessment. 

BACKGROUND OF THE INVENTION 

Many managers and consultants wish to assess knowledge 
worker productivity within an organization or other knowl- 
edge worker community. It is often desirable to assess 
knowledge worker productivity by comparing data associ- 
ated with knowledge workers from one knowledge worker 
community to benchmark data associated with knowledge 
workers from the same or different knowledge worker 
communities. For example, a series of such comparisons 
might be performed to assess knowledge worker productiv- 
ity within an organization, relative to other organizations, 
according to various productivity formulations. 

As knowledge worker environments become larger and 
more complex to serve a variety of tasks and information 
requirements, managers and consultants may desire to assess 
knowledge worker productivity using various productivity 
assessment techniques. A known technique for assessing 
worker productivity measures worker output for a selected 
time period. Although this technique may be acceptable for 
worker communities for which worker output is readily 
susceptible to quantitative measurement, as within most 
manufacturing environments, such techniques may not be 
suitable for environments in which the primary function of 
workers involves obtaining, manipulating, adding value to, 
and acting on information. 

SUMMARY OF THE INVENTION 

In accordance with the present invention, the disadvan- 
tages and problems associated with knowledge worker pro- 
ductivity assessment systems and methods have been sub- 
stantially reduced or eliminated. 

In accordance with one embodiment of the present 
invention, a system for generating a knowledge worker 
productivity assessment includes a database that stores sur- 
vey data and benchmark values, the survey data numerically 
representing a qualitative assessment concerning a criterion 
associated with a knowledge worker. A retriever is coupled 
to the database and retrieves selected survey data and 
benchmark values from the database. A calculator is coupled 
to the retriever and generates a comparison value using the 
selected survey data. A relator is coupled to the calculator 
and generates a knowledge worker productivity assessment 
by comparing the comparison value to a selected benchmark 
value. 

Important technical advantages of the present invention 
include providing a system and method for generating a 
knowledge worker productivity assessment that numerically 
represents qualitative assessments concerning surveyed 
knowledge workers and selected characteristics of the infor- 
mation environment surrounding the surveyed knowledge 
workers in the form of ranks and weights. The system 
generates comparison values using the ranks and weights 
and compares the comparison values with one or more 
benchmark values representing surveys of the same or 
different surveyed knowledge workers. As a result of the 
comparisons, the system generates one or more knowledge 
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worker productivity assessments concerning the surveyed 
knowledge workers. 

Using these knowledge worker productivity assessments, 
managers and consultants can suggest modifications to the 

5 information environment surrounding the surveyed knowl- 
edge workers in order to increase the productivity of the 
surveyed knowledge workers. Knowledge worker produc- 
tivity assessments may be limited to selected knowledge 
workers or groups of knowledge workers within an organi- 

30 zation or knowledge worker community, or may be scalable 
to include knowledge workers from similar knowledge 
worker environments outside the organization or knowledge 
worker community. Other technical advantages are readily 
apparent to one skilled in the art from the following figures, 

15 descriptions, and claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present inven- 
20 tion and for further features and advantages thereof, refer- 
ence is now made to the following description taken in 
conjunction with the accompanying drawings, in which: 

FIG. 1 illustrates a knowledge worker productivity assess- 
ment framework; 
25 FIG. 2 illustrates a knowledge worker productivity assess- 
ment system; and 

FIG. 3 is a flow chart of a method for assessing knowledge 
worker productivity. 

30 DETAILED DESCRIPTION OF THE 

INVENTION 

FIG. 1 illustrates a knowledge worker productivity assess- 
ment framework 2 that includes a plurality of information 

35 criteria 4 and worker criteria 6. All references to a worker, 
workers, worker community, or other grouping of workers 
include knowledge workers, which are generally any work- 
ers whose function involves obtaining, manipulating, adding 
value to, acting on, or any other activity concerning infor- 

40 mation. Each worker or group of workers has an associated 
information environment that includes the information typi- 
cally available to and used by the worker or workers in 
performing various assigned tasks. This information has a 
number of associated characteristics from which informa- 

45 tion criteria 4 may be selected. Similarly, each worker or 
group of workers has associated capabilities typically avail- 
able to the worker or workers in performing assigned tasks. 
These capabilities have a number of associated characteris- 
tics from which worker criteria 6 may be selected. As 

50 discussed more fully below, information criteria 4 and 
worker criteria 6 may be qualitatively assessed by the 
workers and others in order to generate survey data used in 
assessing the productivity of the worker or workers. 
Information criteria 4 may include, without limitation: 

55 "applicability" — the extent to which available information is 
applicable to particular assigned tasks; 
"understandability" — the extent to which available informa- 
tion is understandable to the worker; "credibility" — the 
extent to which available information is accurate; 

60 "locatability" — the extent to which available information 
may be readily located by the worker; "manipulatability" — 
the extent to which available information may be manipu- 
lated by the worker; and any other characteristic of the 
information environment surrounding the worker or workers 

65 suitable for qualitative assessment- 
Information criteria 4 may be organized into one or more 
information sectors 5 according to the relationships between 
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the various information criteria 4. In one embodiment, the 
"applicability," "understandability," and "credibility" infor- 
mation criteria 4 arc organized within an effectiveness 
information sector 8 and the "locatability" and "manipulate 
ability" information criteria 4 are organized within an effi- 
ciency information sector 9. In general, the information 
criteria 4 organized within effectiveness and efficiency infor- 
mation sectors 8 and 9, respectively, concern the value of 
information available to a worker. The present invention 
contemplates any suitable manner of defining information 
criteria 4 and organizing information criteria 4 into one or 
more information sectors 5. 

Worker criteria 6 may include, without limitation: "infor- 
mation usage" — the extent to which workers use and act 
upon available information appropriately; "handling 
.competence" — the extent to which workers receive, 
manipulate, and communicate available information com- 
petently; "handling speed" — the extent to which workers 
receive, manipulate, and communicate available information 
quickly; "hassle generation" — the extent to which workers 
receive, manipulate, and communicate available information 
without generating problems for others; and any other 
characteristic of the capabilities of the worker or workers 
suitable for qualitative assessment. 

Worker criteria 6 may be organized into one or more 
worker sectors 7 according to the relationships between the 
various worker criteria 6. In one embodiment, the "infor- 
mation usage" and "handling competence" worker criteria 6 
are organized within an effectiveness worker sector 11 and 
the "handling speed" and "hassle generation" worker criteria 
6 are organized within an efficiency worker sector 13. In 
general, the worker criteria 6 organized within effectiveness 
and efficiency worker sectors 11 and 13, respectively, con-, 
cera the value added by a worker to the information avail- 
able to the worker. The value of information available to a 
worker may be combined in some manner with the value 
added to the information by the worker to generate a 
knowledge worker productivity level suitable for measure- 
ment and analysis. The present invention contemplates any 
suitable manner of defining worker criteria 6 and organizing 
worker criteria 6 into one or more worker sectors 7. 

Using one or more surveys, information criteria 4 and 
worker criteria 6 may be qualitatively assessed by the 
workers and others according to framework 2 in order to 
generate the survey data used in assessing the productivity 
of the workers. Framework 2 assigns a numeric value or 
rank to each information criterion 4 or worker criterion 6 
each time the particular information criterion 4 or worker 
criterion 6 is qualitatively assessed. The resulting informa- 
tion criteria ranks 50 and worker criteria ranks 52, 
respectively, numerically represent the qualitative content of 
the assessments. In one embodiment, each information cri- 
teria rank 50 and worker criteria rank 52 represents a 
qualitative assessment concerning the perceived importance 
of a particular associated information criterion 4 or worker 
criterion 6, respectively, to the individual performing the 
assessment. 

For example, and not by way of limitation, the "applica- 
bility" information criterion 4 might be assessed according 
to the following scale, the qualitative content of the assess- 
ment determining the associated information criteria rank 
50: "10" — information must consistently be adequate for 
any assigned task; "9" — information must usually be 
adequate for any assigned task; "8" — information must 
sometimes be adequate for specific tasks; "7" — information 
must always be useful generally, but must seldom be 
adequate for specific tasks; "6" — information must often be 
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30 
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60 



useful generally; "5" — information must sometimes be use- 
ful generally; "4" — information must always be interesting, 
but need not be useful; "3" — information must frequently be 
interesting, but need not be useful; "2" — information need 
only be sporadically relevant; "1" — information need not 
ever be relevant. 

Information criteria ranks 50 for the remaining informa- 
tion criteria 4 and worker criteria ranks 52 for worker criteria 
6 would be similarly assigned according to the qualitative 
content of assessments concerning these criteria. The 
present invention contemplates numerically representing the 
qualitative content of assessments concerning information 
criteria 4 and worker criteria 6 in any suitable manner. 
Information sector rank totals 51 and worker sector rank 
totals 53 are equal to the sum of the information criteria 
ranks 50 and worker criteria ranks 52, respectively, within 
each information sector 5 and worker sector 7, respectively. 

Information criteria ranks 50 and worker criteria ranks 52 
may be generated for each information criterion 4 and 
worker criterion 6, respectively, for each worker or group of 
workers within an organization or other worker community. 
Information and worker criteria ranks 50 and 52, 
respectively, may be generated by workers, peers, managers, 
supervisors, or in any other suitable fashion. In one 
embodiment, information criteria ranks 50 are generated by 
individual surveyed workers and worker criteria ranks 52 are 
generated by peers, managers, supervisors, or other associ- 
ates of the surveyed workers, referred to collectively as 
worker associates. 

For example, for a worker community that includes 
twenty workers, each of the twenty workers would be 
surveyed in order to generate information criteria ranks 50 
for each information criterion 4. In addition, selected worker 
associates would be surveyed regarding the group of twenty 
workers as a whole in order to generate worker criteria ranks 
50 for each worker criterion 6. Using information and 
worker criteria ranks 50 and 52, respectively, system 10 
would then generate one or more knowledge worker pro- 
ductivity assessments concerning some or all of the twenty 
workers within the worker community. 

One or more surveys may be conducted to generate 
information criteria ranks 50 and worker criteria ranks 52. In 
one embodiment, each worker within a selected group of 
workers is surveyed, separately or together, depending on 
the scope of the knowledge worker productivity assessment 
to be generated. Each surveyed worker qualitatively assesses 
information criteria 4 and, using framework 2, generates 
information criteria ranks 50 for each information criterion 
4 according to the qualitative content of the assessments. 
Similarly, worker associates are selected and surveyed, 
separately or together, depending on the surveyed workers 
and the scope of the knowledge worker productivity assess- 
ment to be generated. Using framework 2, each surveyed 
worker associate qualitatively assesses worker criteria 6 and 
generates worker criteria ranks 52 for each worker criterion 
6 according to the qualitative content of the assessments. 

The survey data may also include a plurality of informa- 
tion criteria weights 54, information sector weights 55, 
worker criteria weights 56, and worker sector weights 57. In 
general, each weight 54, 55, 56, and 57 numerically repre- 
sents a qualitative assessment, according to framework 2, of 
the relative importance of the associated information crite- 
rion 4, information sector 5, worker criterion 6, or worker 
sector 7. For example, the information criteria weight 54 for 
the "applicability" information criterion 4 might be larger or 
smaller than other information criteria weights 54, depend- 
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ing on the perceived importance of the "applicability" weights to information and worker criteria 4 and 6, 

information criterion 4 to the individual performing the respectively, and information and worker sectors 5 and 7, 

assessment. Similarly, the information sector weight 55 for respectively, according to framework 2. 

the effectiveness information sector 8 might be larger or Collectively, information criteria ranks 50, worker criteria 

smaller than other information sector weights 55 or worker 5 ranks 52( inflation criteria weights 54, worker criteria 

sector weights 57, depending on the perceived importance of . c , . - . . . . , , 

«- & . f ' * o 4 4« * i* *j i r- weights 56, information sector weights 55. and worker 

eflectiveness mformation sector 8 to the mdividual perform- . _. . , 

• ^ e assessmeQt sector weights 57 comprise the survey data. The survey data 

~ . . r ^. . 4 . . , 4 - A , , ... also includes information concerning the surveyed workers, 

Each information catena weight 54 and worker criteria . . A , .*> . *. , 

„ • Kt , _ - r , nc , *™„ t , M nr • , worker associates, worker community, organization, and any 

weight 5o may be specified as a percentage or decimal value, in , . . . t . • j C i r 

u *l * *l r *t. • r • * u* ci 0 ot ner characteristic suitable to create a worker profile for 

such that the sum of the information criteria weights 54 . ji^l . j • 

within each information sector 5 totals 100% or 1.0 and the each s ^ e worker The survey data may be generated in 

r , . . . , ... . , , any suitable manner, for example, usmg bubble charts that 

sum of the worker catena weights 55 within each worker ch,i*i_ljji. jl , 

sector 7 totals 100% or 1 .0. For example, with respect to V e fiUed A m * hind , and Ut "^ a computer or other 

effectiveness information sector 8: the "applicability-' infer- „ ^ ice , ^ discussed ™ re ^ l ' elow "» «>°nection with 

.„ . . . , . , . *r w 15 FIG. 2, the survey data is used to generate one or more 

mation cntenon 4 might be assigned an information cntena , , . * , t ... 

weight 54 of "20 percent" or "02;" the "understandability" w ° rker Productmty assessments concermng .he 

. . c : A . , , , - j . Ci / An surveyed workers or groups of workers, 

mformation cntenon 4 might be assigned a weight 54 of 40 ' & r 

percent" or "0.4;" and the "credibility" information criterion FIG 2 Urates a system for generating a knowledge 

4 might be assigned a weight 54 of "40 percent" or "0.4." worker productivity assessment 10 that includes a database 

Similarly, each information sector weight 55 and worker } 2 Databas / 12 * generally any coUection of data that may 

sectorweight57maybespecifiedasapercentageordecimal bc acccsscd in °/ dcr to retneve > m0fM y> dclc ^ s L tore ' ° r 

value, such that the sum of all information and worker sector communicate information in some manner Database 12 

weights 55 and 57, respectively, totals 100% or 1.0. For deludes a rank database 14 and a weight database 16 that are 

example: effectiveness information sector 8 might be „ populated with survey data 15 after survey data 15 has been 

assigned an information sector weight 55 of "30 percent" or sm ^ h ]r &> mn *** according to framework 2. In one 

"0.3;" efficiency information sector 9 might be assigned a embodiment, rank database 14 is populated with mformation 

weight 55 of "20 percent" or "0.2;" effectiveness worker cntena 50 ^ worker cnt r ena ranks 52 > ™ d wei & ht 

sector 11 might be assigned a worker sector weight 57 of "10 database 16 15 P°P^ d ™& information cntena weights 

percent" or "0.1;" and efficiency worker sector 13 might be 30 54 > information sector weights 55, worker criteria weights 

assigned a weight 57 of "40 percent" or "0.4." One or more 56 » md worker sector wei § hts 57 * The P resent mve *tion 

of the information criteria weights 54, information sector contemplates populating database 12 with survey data 15 in 

weights 55, worker criteria weights 56, or worker sector suitable manner. 

weights 57 may be assigned a zero percentage or zero value Database 12 also includes a benchmark database 18. 

if the associated criterion or sector is perceived to have no 35 Benchmark database 18 contains one or more benchmark 

importance to the particular individual performing the values associated with workers or groups of workers repre- 

assessment. sented by survey data 15 or with survey data generated as a 

An absolute weight 58 may be associated with each result of P^ 1 surveys using workers and others within the 
information criterion 4 according to the product of the same or other organizations or worker communities. Bench - 
particular associated information criteria weight 54 and the <to mark database 18 may include benchmark values suitable 
information sector weight 55. Using the "applicability" for comparison with selected survey data 15 or one or more 
information criterion 4 as an example, if the particular selected manipulations of survey data 15. For example, 
associated information criteria weight 54 is "20 percent" or benchmark database 18 may contain benchmark values for 
"0.2" and the information sector weight 55 for effectiveness information and worker sector rank totals 51 and 53, respec- 
information sector 8 is "30 percent" or "0.3," the absolute 45 tivelv - M discussed more fully below, benchmark database 
weight 58 would be "6 percent" or "0.06." Similarly, an 18 ma y contain benchmark values representing any suitable 
absolute weight 59 may be associated with each worker mathematical or other manipulation of survey data 15 or 
criterion 6 according to the product of the particular asso- information generated as a result of past surveys, 
ciated worker criteria weight 56 and the worker sector System 10 compares selected survey data 15 and manipu- 
weight 57. As FIG. 1 demonstrates: the sum of the absolute 50 lations of survey data 15 with appropriate benchmark values 
weights 58 within each information sector 5 equals the to generate one or more knowledge worker productivity 
associated information sector weight 55; the sum of the assessments concerning the workers or groups of workers 
absolute weights 59 within each worker sector 7 equals the associated with survey data 15. The present invention con- 
associated worker sector weight 57; and the sum of all templates as many benchmark values, generated in any 
absolute weights 58 and 59 equals 100% or 1.0. The present 55 suitable manner and in any suitable form, as are necessary 
invention contemplates assigning and manipulating weights or desirable to generate one or more knowledge worker 
54, 55, 56, and 57 in any suitable manner. productivity assessments using system 10. 

In one embodiment, weights 54, 55, 56, and 57 are Retriever 20 is coupled to and accesses database 12. In 

generated by surveying one or more selected managers, general, retriever 20 retrieves information and worker cri- 

executives or other individuals responsible in some manner 60 teria ranks 50 and 52, respectively, from rank database 14 

for the performance of the surveyed workers. As previously and places information and worker criteria ranks 50 and 52, 

discussed, each weight 54, 55, 56, and 57 numerically respectively, in a format suitable for manipulation by system 

represents an assessment concerning the importance of a 10. Retriever 20 may similarly retrieve and format informa- 

particular information criterion 4, information sector 5, tion and worker criteria weights 54 and 56, respectively, and 

worker criterion 6, or worker sector 7, respectively, accord- 65 information and worker sector weights 55 and 57, 

ing to the qualitative content of the assessment. The present respectively, from weight database 16 and benchmark values 

invention contemplates other suitable methods for assigning from benchmark database 18. The present invention con- 
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templates retrieving information, including survey data 15 or 52 from rank database 14. Modifier 30 may cause system 

and benchmark values, from database 12 in any manner 10 to terminate processing entirely, pending appropriate 

suitable to allow system 10 to generate one or more knowl- modification of one or more incomplete, questionable, or 

edge worker productivity assessments using some or all of otherwise unsuitable ranks 50 or 52. Furthermore, modifier 

the information. s 30 may cause new survey data 15 to be generated to replace 

Retriever 20 is coupled to validator 22. Validator 22 or co ™ bine . ^ some or 311 of to origind survey data 15, 

j * 1 e * j * ■ t. *u j * possibly using one or more modified survey techniques. The 

examines survey data 15 to determine whether survey data r ?■ * i . J 7 1 i ff 

„ u . . r 3 . , j , present invention contemplates modifying survey data 15 or 

15 suitable for generating one or more knowledge worker f, . . / - , 

i & "& ltU5 ^ , the processing activity of system 10 in any suitable manner, 
productivity assessments. Validator 22 examines survey data • j • i . 
15 in accordance with one or more validation parameters 24. 10 C f^ at0 , r 38 "P^ 6 ? ^ manipulates survey data seg- 
For example, validator 22 may confirm that information and ments 32 ' 34 ', ^ 3 f ,n or * er ,0 * , , ne t rtto one or „ mo ? 
worker criteria weights 54 and 56, respectively, total 100% companson values 39 for each survey data segment 32, 34, 
or 1.0 for each information and worker sector 5 and 7, ^ 36 \ M d ^ 3SS ^^ * low > """pares compan- 
respectively, and that the sum of all of the information and * on ?* lue ? & benchmadc values contained m 
worker sector weights 55 and 57, respectively, totals 100% is benchmark database 18 to generate knowledge worker pro- 
of 1.0. If survey data 15 is not sufficiently complete or there assessments for survey data segments 32, 34 and 
is some other reason to question the validity of survey data 3 ^ Calculator 38 is coupled to and may access survey data 
15, as specified by validation parameters 24, tben validator 15 „ conU ? n ed m , wei S ht **** * 16 > in f dm S 
22 may respond in some suitable manner. In one wo * er cnte " a wel * hts 54 , and 56, respectively, and 
embodiment, vaUdator 22 responds by invoking modifier 30, » "formation and worker sector weights 55 and 57, 
as discussed more fully below. ' es f e c n , v elv i ' n 0lder t0 S^erate comparison values 39. 

' Calculator 38 may access weight database lo directly or 

Validator 22 is coupled to segmentor 26. Segmentor 26 syslem 10 may reIrieve and format information from weight 

examines survey data 15, including information and worker databas6 16 ^ retricver 20 ins , ead of or m addition , 0 

cntena ranks 50 and 52, respectively, and determines calculator 38 

whether to segment survey data 15 into multiple survey data 25 ^ discussed abo each dala nt 32 34 and 

segments 32, 34, and 36. Segmentor 26 examines survey 36 indude ^ 15 ted M a ^ of 

data 15 according to one or more segmentation parameters „ u > , ^ i i * « • i . j . 

. & fe , ^ multiple surveys. Calculator 38 may manipulate survey data 

28. h or example, segmentor 26 may segment survey data 15 1e , ■ , • , . * i-T u j « . 

r ' , & • j • . * . 15 contained in survey data segments 32, 34, and 36 and 

according to profiles associated with some or all of the . u * a * u %c ♦ . .u r n • 

r / , , - 30 weight database 16 to generate the following comparison 

surveyed workers, worker associates, worker communities, lfl e u • £ *• •* ■ a * i 

. t . . . . ... values 39 tor each information criterion 4 and worker 

organizations, or other identifiable groups with which sys- * m, ♦ tw. *■ .u u- u i j- 

4 6 * n i , . • criterion 6, without limitation: the high, low, mean, median, 

tem 10 may be concerned, segmentation parameters 28 a * a a a - c • c *• j i •» ■ 

. c . t / . , ^ ~, ^ A , , and standard deviation for information and worker cntena 

specifying the manner in which the profiles are segregated to ^ 5ft and 52 ^ lhe , medi 

form survey data segments 32, 34, and 36. j * j j j • *■ r • r *■ j i • 

b 35 and standard deviation for information and worker cntena 

Greater uniformity within each survey data segment 32, weights 54 and 56, respectively; the high, low, mean, 

34, or 36 may allow system 10 to generate more meaningful median, and standard deviation for weighted values equal to 

knowledge worker productivity assessments for the workers the product of the information and worker criteria ranks 50 

represented by survey data segments 32, 34, and 36. and 52f respectively, and their associated information and 

Therefore, segmentation parameters 28 may also specify a 4Q wor ker criteria weights 54 and 56, respectively, or informa- 

numencal range within which the survey data 15 for each uon and worker sector weights 55 and 57, respectively; the 

survey data segment 32, 34, and 36 must lie, based on a high, low, mean, median, and standard deviation for absolute 

mean and a standard deviation associated with each survey weights 58 and 59, respectively; the high, low, mean, 

data segment 32, 34, and 36. For example, if information median, and standard deviation for an absolute weighted 

criteria ranks 50 are not sufficiently uniform for the surveyed 45 va i ue equal to me pro duct of the information and worker 

workers or group of workers, as specified by segmentation criteria ranks 50 and 52, respectively, and their associated 

parameters 28, then segmentor 26 may segment survey data absolute weights 58 and 59, respectively; and any other 

15 into survey data segments 32, 34, and 36 for which ranks value suitable for comparison with one or more benchmark 

50 are more internally uniform. values contained in benchmark database 18. 

Although only survey data segments 32, 34, and 36 are 50 Calculator 38 may also generate the following compari- 

discussed, the present invention contemplates segmenting son values 39 for each information sector 5 and worker 

survey data 15, including ranks 50 and 52, into as many sector 7, without limitation: the high, low, mean, median, 

survey data segments as are necessary or desirable. System and standard deviation for information and worker sector 

10 may generate distinct knowledge worker productivity rank totals 51 and 53, respectively; the high, low, mean, 

assessments for each survey data segment 32, 34, and 36. 55 median, and standard deviation for information and worker 

Segmentor 26 may further respond by invoking modifier 30 sector weights 55 and 57, respectively; and any other value 

instead of or in addition to segmenting survey data 15. suitable for comparison with one or more benchmark values 

Validator 22 and segmentor 26 are coupled to modifier 30 contained in benchmark database 18, 

and may invoke modifier 30 in response to examining Calculator 38 may further generate the following com- 

survey data 15 in accordance with validation parameters 24 60 parison values 39, without limitation: the high, low, mean, 

or segmentation parameters 28, respectively. Modifier 30 median, and standard deviation for a value of available 

may modify survey data 15, including information criteria information equal to the sum of information sector rank 

ranks 50 and worker criteria ranks 52, or may modify the totals 51; the high, low, mean, median, and standard devia- 

processing activity of system 10 in any suitable manner. For tion for a value added by the worker to the available 

example, modifier 30 may prevent system 10 from further 65 information equal to the sum of worker sector rank totals 53; 

processing one or more incomplete, questionable, or other- the high, low, mean, median, and standard deviation for a 

wise unsuitable ranks 50 or 52 and may delete such ranks 50 knowledge worker productivity level equal to the sum all 
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information sector rank totals 51 and worker sector rank some or all of the original survey data 15, possibly using one 

totals 53; and any other value suitable for comparison with or more modified survey techniques, 

one or more benchmark values contained in benchmark Reporter 44 receives knowledge worker productivity 

database 18. Calculator 38 may generate comparison values assessment generated using relator 40 and, in response, 

39 for each survey data segment 32, 34, and 36 in a serial s generates analysis reports. The analysis reports may be 

fashion or more or less simultaneously. The present inven- Md fa manner ^ m fo J suiuWe for 

tion contemplates any suitable method of generating one or , • . / , J 

r . i an ■ j . |> analysis by, for example, managers, supervisors, 

more comparison values 39 using survey data 15. i. . i . L j • 

r* i * jia • ■ i m . < i consultants, analysts, or computers or other devices. 

Relator 40 receives comparison values 39 generated by n J » r 

calculator 38 and compares comparison values 39 to one or 10 „ S y stem ™ ma y 0 P e , rate on one or more computers 60. 

more benchmark values contained in and selected from Computer 60 may include an input device 62, such as a 

benchmark database 18. Benchmark database 18 may con- ke yP ad > touch or other device lhat acce P l infor ' 

tain one or more benchmark values for each comparison mauon * An out P ul dcvice 64 ma y information asso- 

value 39. As discussed above, the benchmark values may be ciat f d ™ lh lhe 0 P era ^ on of system 10, mcluding digital or 

associated with workers or groups of workers represented by - , dala > ™^ information, or audio information. Both 

survey data 15 or with survey data generated as a result of m P ut device 62 and 0Ut P ut device 64 ma y fixed or 

past surveys using workers and others within the same or r *™ Va ^ e storag l c med f a ^ uch magnetic computer disks, 

other organizations or worker communities. Therefore, sys- CD-ROM, or other suitable media to both receive output 

tem 10 may generate relative knowledge worker productiv- hom and P r ™ de in P ut t0 s y stcm 10 - Computer 60 may have 

ity assessments for selected workers or groups of workers , n a Pressor 66 and an associated volatile or non-volatile 

associated with survey data 15 by comparing comparison m^ory to execute instructions and manipulate information 

values 39 with one or more appropriate benchmark values. m accordance with the operation of system 10. 

For example, a particular comparison value 39 might be In operation, retriever 20 retrieves survey data 15 from 

the absolute weight associated with the "applicability" infer- rank database 14 > including information and worker criteria 

mation criterion 4 and equaling "0.06," and a suitable « ranks 50 and 52, respectively, and formats survey data 15 for 

benchmark value for comparison value 39 might be manipulation by system 10. Validator 22 examines survey 

"0.16."The disparity between comparison value 39 and the data 15 m accordance with validation parameters 24, and 

benchmark value of "ten percent" or "0.10" might indicate segmentor 26 segments survey data 15, if necessary or 

that one or more variables associated with the surveyed desirable, into survey data segments 32, 34, and 36 in 

worker or workers requires attention in some manner. 30 accordance with segmentation parameters 28. Modifier 30 

Although in this example, the disparity is expressed as a ma y modi fy survev data 15 or the Processing activity of 

mathematical difference, the present invention contemplates s y stem 10 according to the activities of validator 22 or 

determining and expressing any disparity with respect to a segmentor 26 and validation parameters 24 and segmenta- 

standard deviation, as a percentage of other survey data 15, uon parameters 28, respectively. 

with respect to relative percentiles or quartiles, or in any 35 Calculator 38 receives and manipulates survey data seg- 

other suitable manner. Knowledge worker productivity ments 32, 34, and 36 in order to generate one or more 

assessments generated using relator 40 may communicate comparison values 39 for each survey data segment 32, 34, 

such concerns to appropriate individuals associated with the arj d 36. Calculator 38 may access survey data 15 contained 

surveyed worker or workers in order to improve the pro- in weight database 16, including information and worker 

ductivity of the surveyed worker or workers. As discussed 40 criteria weights 54 and 56, respectively, and information and 

below, relator may also invoke modifier 42 instead of or in worker sector weights 55 and 57, respectively, in generating 

addition to generating a knowledge worker productivity comparison values 39. 

assessment. Relator 40 receives comparison values 39 for survey data 
The present invention contemplates comparing as many segments 32, 34, and 36 from calculator 38 and compares 
comparison values 39 with benchmark values as is necessary 45 comparison values 39 to selected benchmark values Con- 
or desirable. Relator 40 may access benchmark database 18 tained in benchmark database 18. In response to these 
directly or system 10 may retrieve and format information comparisons, relator 40 generates one or more knowledge 
from benchmark database 18 using retriever 20 instead of or worker productivity assessments for the workers or groups 
in addition to relator 40. Relator 40 may generate one or of workers represented by survey data segments 32, 34, and 
more productivity assessments for each survey data segment 50 36. Relator 40 may use benchmark database 18 to store one 
32, 34, and 36 in a serial fashion or more or less simulta- or more comparison values 39 for use as benchmark values 
neously. The present invention contemplates any suitable in generating subsequent knowledge worker productivity 
method for comparing a comparison value 39 with a bench- assessments. Relator 40 may also invoke modifier 42 in 
mark value in order to generate a knowledge worker pro- response to the comparisons. 

ductivity assessment. The present invention contemplates 55 Reporter 44 receives knowledge worker productivity 

using benchmark database 18 to store one or more compari- assessments generated using relator 40 and, in response, 

son values 39 for use as benchmark values in generating generates analysis reports. The present invention contem- 

subsequent knowledge worker productivity assessments. plates any suitable method for assessing worker productivity 

Relator 40 is coupled to modifier 42 and may invoke using database 12, retriever 20, validator 22, segmentor 26, 

modifier 42 in response to comparing one or more compari- 60 modifier 30, calculator 38, relator 40, modifier 42, and 

son values 39 with one or more benchmark values. Modifier reporter 44. 

42 may modify survey data 15, including information and FIG. 3 is a flow chart of a method for assessing knowledge 

worker criteria weights 54 and 56, respectively, and infer- worker productivity using system 10. The method begins at 

mation and worker sector weights 55 and 57, respectively, or step 100, where information criteria 4 and worker criteria 6 

may modify the processing activity of system 10 in any 65 are specified. As discussed more fully above, each informa- 

suitable manner. Furthermore, modifier 42 may cause new tion criterion 4 is selected from a number of characteristics 

survey data 15 to be generated to replace or combine with associated with the information environment surrounding a 
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worker or group of workers, and each worker criterion 6 is 106 by surveying one or more selected managers, 

selected from a number of characteristics associated with the supervisors, executives, or other individuals responsible for 

capabilities of the worker or group of workers. the performance of the surveyed workers. The present 

At step 102, information and worker criteria 4 and 6, invention contemplates generating weights 55, 55, 56, and 

respectively, are organized into information and worker s 57 in any suitable manner. 

sectors 5 and 7, respectively, according to the relationships At step 108, survey data 15 is provided to knowledge 
between the various information and worker criteria 4 and 6, worker productivity assessment system 10. Survey data 15 
respectively. Information and worker sectors 5 and 7 may be may include, without limitation, information and worker 
specified and organized in any suitable manner. Once speci- criteria ranks 50 and 52, respectively, information and 
fied and suitably defined, information criteria 4, worker 10 worker criteria weights 54 and 56, respectively, and infor- 
criteria 6, information sectors 5, and worker sectors 7 may mation and worker sector weights 55 and 57, respectively, 
be qualitatively assessed by workers and others in order to As discussed more fully above in connection with FIG. 2, 
generate survey data 15. survey data 15 may be provided using database 12, rank 
At step 104, information criteria 4 and worker criteria 6 database 14, and weight database 16, in any suitable corn- 
are qualitatively assessed in order to generate information 15 bination. Survey data 15 may be provided in any suitable 
criteria ranks 50 and worker criteria ranks 52, respectively. manner. 

As discussed more fully above in connection with FIG. 1, At step 110, retriever 20 retrieves survey data 15 from 

framework 2 assigns a numerical value to each information database 12 and, if necessary, places survey data 15 in a 

and worker criterion 4 or 6, respectively, each time the format suitable for manipulation by system 10. Retriever 20 

particular criterion 4 or 6 is qualitatively assessed. The 20 may retrieve all of the survey data 15 at step 110 or only 

resulting information criteria ranks 50 and 52, respectively, some of the survey data 15, for example, information and 

numerically represent the qualitative content of the assess- worker criteria ranks 50 and 52, respectively. The present 

ments. In one embodiment, each information criteria rank 50 invention contemplates retrieving survey data 15 in any 

and worker criteria rank 52 numerically represents a quali- manner suitable to allow system 10 to generate one or more 

tative assessment concerning the perceived importance of a 25 knowledge worker productivity assessments using some or 

particular associated information or worker criterion 4 or 6, all of the survey data 15. 

respectively, to the individual performing the assessment. At step u 2 , validator 22 examines survey data 15 in 

One or more surveys may be conducted at step 104 to accordance with one or more validation parameters 24. For 

generate information and worker criteria ranks 50 and 52, ^ Q example, validator 22 may confirm that information and 

respectively. In one embodiment, each worker within a worker criteria weights 54 and 56, respectively, total 100% 

selected worker community or other group of workers is or 1.0 for each information and worker sector 5 and 7, 

surveyed, separately or together, depending on the scope of respectively, and that the sum of all of the information and 

the knowledge worker productivity assessment to be gener- worker sector weights 55 and 57, respectively, totals 100% 

ated. Each surveyed worker qualitatively assesses informa- 35 or 1.0. At step 114, if survey data 15 is deemed valid, as 

tion criteria 4 and, according to framework 2, generates specified by validation parameters 24, then the method 

information criteria ranks 50 for each information criterion proceeds directly to step 120, where segmentor 26 examines 

4 according the qualitative content of the assessments. survey data 15 in accordance with segmentation parameters 

Similarly, worker associates such as peers, managers, and 28. If survey data 15 is not sufficiently complete or there is 
supervisors of the surveyed workers are selected and 40 some other reason to question the validity of survey data 15, 
surveyed, separately or together, depending on the surveyed as specified by validation parameters 24, then validator 22 
workers and the scope of the knowledge worker productivity may respond at step 116 by invoking modifier 30 or other- 
assessment to be generated. Each worker associate qualita- wise alerting system 10 to the condition. For example, as 
tively assesses worker criteria 6 and, according to frame- discussed above in connection with FIG. 2, modifier 30 may 
work 2, generates worker criteria ranks 52 for each worker 45 modify survey data 15, such as by deleting the incomplete 
criteria 6 according to the qualitative content of the assess- or otherwise unsuitable ranks 50 and 52, or may modify the 
ments. The present invention contemplates generating infor- processing activity of system 10 in some suitable manner, 
mation and worker criteria ranks 50 and 52, respectively, in Modifier 30 may allow system 10 to continue further 
any suitable manner at step 104. processing with respect to the validated survey data 15 or 

At step 106, information criteria weights 54, worker so may cause system 10 to terminate processing entirely, pend- 

criteria weights 56, information sector weights 55, and ing modification of survey data 15. Whether or not system 

worker sector weights 57 are generated according to frame- 10 continues further processing with respect to the validated 

work 2. In general, each weight 54, 55, 56, and 57 numeri- survey data 15, modifier 30 may cause new survey data 15 

cally represents a qualitative assessment concerning the to be generated at step 122 to replace or combine with the 

relative importance of the particular associated information 55 original survey data 15. If new survey data 15 is to be 

criterion 4, worker criterion 6, information sector 5, and generated, the method returns to step 100 where new survey 

worker sector 7, respectively, according to the qualitative data is generated to replace or combine with the original 

content of the assessment. survey data 15, possibly using one or more modified survey 

As discussed more fully above in connection with FIG. 1, techniques. Otherwise, the method returns to step 108, 

each weight 54, 55, 56, and 57 may be specified as a 60 where tne modified survey data 15 is provided to system 10. 

percentage or decimal value, such that: the sum of the At step 120, segmentor 26 examines survey data 15 in 

information criteria weights 54 within each information accordance with one or more segmentation parameters 28. 

sector 5 totals 100% or 1.0; the sum of the worker criteria Based on this examination, segmentor 26 may segment 

weights 56 within each worker sector 7 totals 100% or 1.0; survey data 15, including information and worker criteria 

and the sum of all of the information and worker sector 65 ranks 50 and 52, respectively, into one or more survey data 

weights 55 and 57, respectively, totals 100% or 1.0. In one segments 32, 34, and 36 at step 124. For example, if 

embodiment, weights 54, 55, 56, and 57 are generated at step information and worker criteria ranks 50 and 52, 
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respectively, are not sufficiently uniform for the surveyed 
workers or group of workers, as specified by segmentation 
parameters 28, segmentor 26 may segment ranks 50 and 52 
into survey data segments 32, 34, and 36 that are more 
internally uniform. Segmentor 26 may also segment survey 
data 15 according to profiles associated with some or all of 
the surveyed workers, worker associates, worker 
communities, organizations, or other identifiable groups 
with which system 10 may be concerned, segmentation 
parameters 28 specifying the manner in which the profiles 
are segregated to form survey data segments 32, 34, and 36. 

If survey data 15 is not segmented at step 124, the method 
proceeds directly to step 128, where calculator 38 generates 
comparison values 39 using survey data 15. If survey data 15 
is segmented at step 124, segmentor 26 may further respond 
by invoking modifier 30, in which case the method proceeds 
as discussed above in connection with validator 22. If no 
modifications to survey data 15 or the processing activity of 
system 10 are necessary or desirable at step 126, calculator 
38 calculates comparison values 39 using survey data seg- 
ments 32, 34, and 36 at step 128. The present invention 
contemplates generating comparison values 39 at step 128 
whether or not modifier 30 is invoked. 

Calculator 38 may access survey data 15 contained in 
weight database 16, directly or using retriever 20, including 
information and worker criteria weights 54 and 56, 
respectively, and information and worker sector weights 55 
and 57, respectively, in order to generate comparison values 
39. As discussed more fully above in connection with FIG. 
2, any suitable comparison values 39 may be generated 
using survey data 15, including absolute weighted values for 
each information and worker criterion 4 and 6, respectively, 
and information and worker sector rank totals 51 and 53 for 
each information and worker sector 5 and 7, respectively. 
Comparison values 39 may be generated in any form and in 
any manner suitable to allow system 10 to generate one or 
more knowledge worker productivity assessments using 
comparison values 39. 

At step 130, relator 40 receives comparison values 39 for 
survey data segments 32, 34, and 36 and compares com- 
parison values 39 to one or more benchmark values con- 
tained in and selected from benchmark database 18. As 
discussed more fully above in connection with FIG. 2, 
benchmark database 18 may contain one or more benchmark 
values for each comparison value 39. In one embodiment, 
each benchmark value represents survey data generated as a 
result of past surveys using workers and others within the 
same or other organizations or worker communities. The 
present invention also contemplates using benchmark values 
that associated with workers or groups of workers repre- 
sented by survey data 15 and manipulations of survey data 
15. For example, information and worker sector rank totals 
51 and 53, respectively, for one group of workers repre- 
sented by survey data 15 may be used as benchmark values 
for comparison with comparison values 39 generated for 
other workers or groups of workers represented by survey 
data 15. 

In response to comparing selected comparison values 39 
with appropriate benchmark values at step 130, system 10 
generates knowledge worker productivity assessments for 
the workers associated with each survey data segment 32, 
34, and 36 at step 132. The present invention contemplates 
as many benchmark values as are necessary or desired, 
generated in any form and in any suitable manner, in order 
to generate one or more knowledge worker productivity 
assessments using the benchmark values. 

At step 134, relator 40 may invoke modifier 42 in order 
to modify survey data 15 contained in criteria weight file 16, 
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including information and worker criteria weight factors 54 
and 56, respectively, and information and worker sector 
weight factors 55 and 57, respectively, according to the 
comparisons performed by comparing module 40. Modifier 

5 42 may also modify the processing activity of system 10 in 
some suitable manner. Furthermore, it may be desirable to 
modify the benchmark values contained in benchmark data- 
base 18 to include the comparison values 39 generated using 
calculator 38. Modifier 42 may be invoked, if at all, before, 

1Q during, or after relator 40 generates some or all of the 
knowledge worker productivity assessments. If modifier 42 
is invoked at step 134, the method proceeds as discussed 
above in connection with validator 22, where validator 22 
invokes modifier 30 at step 116. If no modifications to 
survey data 15 or the processing activity of system 10 are 

15 necessary or desirable at step 134, analysis reports are 
generated at step 136 using reporting capability 44. The 
present invention contemplates generating analysis reports 
whether or not modifier 42 is invoked. 

2Q Although the present invention has been described with 
several embodiments, a plethora of changes, substitutions, 
variations, alterations, transformations and modifications 
may be suggested to one skilled in the art, and it is intended 
that the present invention encompass such changes, 
substitutions, variations, alterations, transformations and 

25 

modifications as fall within the spirit and scope of the 
appended claims. 
What is claimed is: 

1. A system operable on one or more computers for 
generating a knowledge worker productivity assessment, 
comprising: 

a database operable to store survey data and at least one 
benchmark value, the survey data representing a quali- 
tative assessment concerning a predetermined criterion 

3S associated with a knowledge worker; 

a retriever coupled to the database and operable to retrieve 
selected survey data and a selected benchmark value 
from the database, the retriever operable to communi- 
cate the selected survey data and benchmark value; 

40 a segmentor coupled to the retriever and operable to 
segment the retrieved survey data into a plurality of 
survey data segments according to one or more seg- 
mentation parameters; 
a calculator coupled to the retriever and operable to 

45 receive the survey data and to generate a comparison 
value for at least one survey data segment; 
a relator coupled to the calculator and operable to receive 
the benchmark value and to generate a knowledge 
worker productivity assessment by comparing a com- 

50 parison value for a survey data segment to the selected 
benchmark value. 

2. The system of claim 1, further comprising a validator 
operable to examine the selected survey data according to a 
sum of survey responses. 

55 3. The system of claim 1, wherein the segmentor is 
operable to segment the selected survey data into a plurality 
of survey data segments according to a knowledge worker 
profile. 

4. The system of claim 1, wherein the qualitative assess- 
60 ment concerns the perceived importance of the criterion to 

the individual performing the assessment. 

5. The system of claim 1, wherein the survey data 
comprises a plurality of criteria ranks, each criteria rank 
associated with a particular criterion. 

65 6. The system of claim 1, wherein the survey data includes 
a plurality of criteria weights, each criteria weight associated 
with a particular criterion. 
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7. The system of claim 1, wherein the survey data is 
arranged in one or more sectors, each sector including one 
or more criteria and having an associated sector weight. 

8. The system of claim 1, wherein the comparison value 
is a sector rank total equal to the sum of one or more criteria 
ranks associated with a sector. 

9. The system of claim 1, wherein the comparison value 
is an absolute weighted value equal to the product of a 
criteria rank, a criteria weight, and a sector weight. 

10. A method operable on one or more computers for 
generating a knowledge worker productivity assessment, 
comprising: 

providing survey data numerically representing a quali- 
tative assessment concerning a predetermined criterion 
associated with a knowledge worker; 

storing the survey data and at least one benchmark value 
in a database; 

retrieving selected survey data and a selected benchmark 
value from the database; 

generating a comparison value using the selected survey 
data, the comparison value being weighted according to 
at least a criteria weight; 

comparing the comparison value to the selected bench- 
mark value; and 

generating a knowledge worker productivity assessment 
according to the comparison. 

11. The system of claim 10, wherein the qualitative 
assessment concerns the perceived importance of the crite- 
rion to the individual performing the assessment. 

12. The method of claim 10, wherein the survey data 
comprises: 

a plurality of criteria ranks, each criteria rank associated 
with a particular criterion; 

a plurality of criteria weights, each criteria weight asso- 
ciated with a particular criterion; and 

a plurality of sector weights, each sector weight associ- 
ated with a particular criterion. 

13. The system of claim 10, wherein the comparison value 
is a sector rank total equal to the sum of one or more criteria 
ranks associated with a sector. 

14. The system of claim 10, wherein the comparison value 
is an absolute weighted value equal to the product of a 
criteria rank, a criteria weight, and a sector weight. 
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15. The system of claim 10, wherein the benchmark value 
represents survey data associated with a past survey con- 
cerning a knowledge worker. 

16. A method operable on one or more computers for 
5 generating a knowledge worker productivity assessment, 

comprising: 

providing survey data numerically representing a quali- 
tative assessment concerning a predetermined criterion 
associated with a knowledge worker; 
10 storing the survey data and at least one benchmark value 
in a database; 

retrieving selected survey data and a selected benchmark 

value from the database; 
segmenting the survey data into a plurality of survey data 
15 segments according to one or more segmentation 

parameters; 

generating a comparison value for each survey data 

segment using a calculator; 
comparing, for each survey data segment, the comparison 
20 values to the selected benchmark value; and 

generating a knowledge worker productivity assessment 

according to the comparison. 

17. The method of claim 16, wherein the survey data is 
2j generated according to a framework that assigns numerical 

representations to qualitative assessments concerning crite- 
ria associated with a knowledge worker according to the 
qualitative content of the assessments. 

18. The method of claim 16, wherein the survey data 
3Q comprises: 

a plurality of criteria ranks, each criteria rank associated 
with a particular criterion; 

a plurality of criteria weights, each criteria weight asso- 
ciated with a particular criterion; and 
35 a plurality of sector weights, each sector weight associ- 
ated with a particular criterion. 

19. The method of claim 16, wherein the comparison 
value is an absolute weighted value equal to the product of 
a criteria rank, a criteria weight, and a sector weight. 

40 20. The method of claim 16, wherein the segmentation 
parameters specify segmenting the survey data according to 
a knowledge worker profile associated with surveyed work- 
ers. 

***** 



04/16/2004, EAST Version: 1.4.1 



